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REliARKS/ARGUiiEm 
Prior to this Amendment, claims 1, 3-15, 17-20, 22, 23, and 25-30 were 
pending in the application. No claim amendments are presented at this time, 
and the listing of claims is provided only for completeness and to facilitate the 
review by the Examiner. 

The March 22, 2007 Office Action was issued in response to an Appeal 
Brief filed by the Applicant and reopened prosecution. The Examiner performed 
an additional search rather than allowing the appeal to continue and has cited 3 
new patent references in rejecting the cteims. 

Because this is the first time these references were cited and because 
prosecution was reopened by the Patent Office, Applicant requests that the 
finality of the March 22, 2007 Office Action be reconsidered and the action be 
considered a non-final action. 

Claim R@|@ctioo« Under 3S U.S.C. §103 

In the March 22, 2007 Office Action, claims 1. 3-5, 8, 11-15, 17, 18, 20, 
22, 23, and 25-30 were rejected under 35 U.S.C. §1 03(a) as being unpatentable 
over U.S. Pat No. 5,914,757 ("Dean") in view of U.S. Pat. No. 7,043,749 
("Davies"). This rejection is respectfully traversed based on the following 
remarks, which begin with a general discussion of embodiments of Applicant's 
invention and then proceed with a discussion of specific claim language and 
remarks distinguishing the teaching of both Dean and Davies. 

Before turning to specific claim language, it may be useful to more 
generally describe some of the significant differences between Applicant's 
invention and the technologies described in Dean and Davies. Applicant's 
system is effective for mixing received streams with video portions that have 
been streamed over differing networks and/or different network paths. This is 
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important where two or more sources of video streams are being combined into 
a single stream. Video time-based synchronization requires synchronization in 
the 100 nanosecond or tower range with higher definition requiring even higher 
levels of synchronization. In part, this Is because video mixing may involve 
syperimpositlon of two images or fading one into another or cutting a hole and 
then matting another into the hole (e.g., mixing, matting, keying, and the like). 
For example, a live stream of a news or weather anchor may be keyed into a 
hole created in another live stream (e.g., a stream of live action video or weather 
map or the like) during mixing operations. Such mixing may involve mapping 
video streams on a pixel-by-pixel basis or even fractions of pixels (e.g., image 
element in one stream to an image element In another stream). Such video 
mixing is often orders of magnitude more accurate than that required to match 
an audio signal to a video signal. 

Prior to the invention as noted in Applicant's Background, the problems 
associated with such mixing of media streams transmitted over the Internet and 
other networks had not been addressed, and one solution was to simply display 
video streams separately (e.g., avoid mixing) or at most try to synchronize a 
sound stream with a video stream but again without mixing. Note also that the 
difference between mere multiplexing of video streams and the mixing described 
by Applicant was explained in detail in Applicant's September 12, 2005 
Amendment. 

There are numerous differences between the time-based mixing of 
received signals as taught by Appellant and the teaching of Dean. Generally, 
Dean discusses issues with taking video signals from two sources that may 
"differ in both frequency and phase" (col. 1 , line 63) and the need for the display 
device to accommodate for both frequency and phase differences such that the 
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source and display frequency and phase are synchronized (col. 2, lines 1-20). 
Prior art devices are said to solve these synchroneation problems by adjusting 
"the display frequency and phase to match the frequency and phase of the 
source of the primary video image" (col. 2, lines 21-27). 

Dean is directed to a device and method for improving on traditional 
picture-in-picture (PIP) display systems to avoid jumps or other issues (e.g.. one 
screen or both black out momentarily) with prior art PIP devices such as that 
shov^n in Figure 1 that were used to sync phase and frequency of the primary 
image and the secondary image (the PIP image) when changes are made 
between these two channels or "sources" (see, for example, col. 6, lines 9-26). 
To this end, Dean teaches use of the PIP display of Figure 2 where two input 
channels or sources 161, 162 have their signals stored in buffers 140A, 140B. 
Then, as noted beginning at col. 6, line 63, Dean teaches that "neither buffered 
video signal is synchronized, per se, to one of the channel inputs, and thus, a 
change of the source of one channel would not affect the display of the other." 
The sync control 220 and memory controls 130A. 130B act such that the 
synchronization signal 266 is "synchronous with the source of the image most 
noticeable to the user" (col. 7, lines 23-25) such as the larger of the two screens. 
The synchronization signal is used to match source frequencies to control video 
judder but constant to control video jumps and this paradoxical design Issue for 
controlling frequency and phase synchronization of the two channel signals 161, 
162 is addressed with the Phase Locked Loop embodiment of the Dean system 
described in col, 7, line 53 to coL 10, line 19. Mixer 150 Is used to generate a 
PIP Image for display on video display 100 based on the buffered signals 173A, 
173B. 
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Significant to Applicant's invention, the Dean system provides an 
improvement over prior PIP display devices but fails to discuss time-based 
synchronization and there is nothing to indicate the signals on channels 161, 162 
are not provided in standard form such as by a common television content 
provider such as a cable TV or dish TV provider. There is no discussion in Dean 
of problems associated with variable transmission delays that may occur with 
transmission of data packets or media streams over the internet or similar 
networks. Instead, Dean is only concerned with synchronizing frequency and 
phase of a source with a display device and not with time synchronizing two 
concurrently displayed images. For example, Dean is not concerned with 
whether its primary image and its secondary image are displayed in a time-based 
manner at all but only that the frequencies are matched to avoid image judder or 
jumps. Such control does not require any concern over when the signals on 
channels 161, 162 were transmitted from an originating source or when they are 
received at the PIP display device of Figure 2. In contrast, Applicant provides 
methods and systems that combine two or more video streams received from 
differing sources (e.g., over differing networks or paths) and with differing 
transmission times or delays into a single stream in which the streams are 
synchronized (e.g., mapped pixel to pixel in some cases) based on transmission 
time from their sources. Frequency and phase issues discussed in Dean may 
still have to be addressed to create a PIP display without jump or judder, but this 
is a distinct issue relative to the time-based synchronization addressed by 
Applicant. 

Davles is directed toward a network gateway for use in synchronizing 
audio signals delivered over a telephony network and video signals delivered 
over a digital communications network to provide "lip-synch." As discussed in 
prior Amendments, synchronizing audio and video signals is much easier than 
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synchronizing video streams (such as down to the pixel levei), with Davies noting 
in col. 9, lines 60-64 that mismatches of up to 10 to 40 milliseconds are 
acceptable. However, Applicant does understand that Davies is attempting to 
solve a time-based synchronization problem. But, Davies attacks the problem 
very differently than Applicant even in the audio to video realm. SpecificaHy, 
Davies teaches in col. 10 that it is assumed that "network propagation delays are 
predictable" (coi. 10, lines 25-30) in the design of the gateway and that "network 
propagation delays may be assumed to be constant during a call as users can 
cope with minor blips in synchronization" (col. 10, lines 46-48). in contrast. 
Applicant's invention is directed to solving problems associated with "non- 
deterministic delays" and "variable transmission rates" that may for each media 
stream or even on a packet-by-packet basis (e.g., even from a single source the 
path of data packets may vary within the stream or from stream to stream). 

With these assumptions in mind, Davies teaches in its Summary of the 
Invention, in col. 12, and elsewhere a calibration technique for particular video 
equipment, compression and encoding algorithms, and transmission of test 
audio and video signals. For the particular systems configuration, a mismatch is 
determined for the synchronization and a "variable delay" in the gateway is 
adjusted until the two signals are synchronized. Then, with reference to Figure 
1, the calibrated gateway 101 is used to apply this variable delay on a signal 
routed through the gateway, such as the audio signal or the video signal, when 
one of the combined multimedia terminals are used. There is no ongoing 
adjustment for variable transmission delays as the "variable delay" is stored for 
"in the gateway for future use" (col. 2, line 45) and "only new combinations of 
audio and video devices on different networks will need calibration" (col. 12, lines 
4-8), Hence, Davies teaches a one-time calibration technique for accounting for 
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differing delivery rates for an audio signal and a video signal, such as may be 
useful for video conferencing. 

However, wlien compared generally with Applicant's invention, there is no 
teaching of determining transmission delay for both of two received streams as it 
only teaches tuning or adjusting a delay applied to a signal passing through a 
gateway device until synchronization is achieved one time and then storing that 
delay value (e.g., that actual delay of either of the signals does not have to be 
determined). Hence, there is no teaching of looking at information in the video 
streams themselves to determine such a delay value. Further, Davies provides 
no teaching that the two signals are mixed or combined in any manner as the 
stored variable delay is simply applied to one of the signals but both signals are 
delivered to their separate terminals (e.g., audio terminal 104 and video terminal 
105 of a combined multimedia terminal 108). Hence, there Is no teaching of 
placing the two signals into a neutral form prior to storage in a buffer to facilitate 
later combination into a sequential or concurrent composite media stream. 

Turning now to the claim language, claim 1 calls for an input interface that 
receives first and second media streams that each include a streaming video 
portion. According to claim 1, the two media streams "comprise a plurality of 
digital packets being transmitted over the communications network from a first 
and a second media source." A controller determines a "variable transmission 
delay for the first and second media streams from the first and second media 
sources to the input interface and performs the selective retrieving based on the 
determined variable transmission delays." Additionally, the controller mixes the 
retrieved time-adjusted streams "into a composite media stream wherein the first 
and second time-adjusted streams are synchronized based on time." The 
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combined teaching of Dean and Davies fails to teach or suggest each of these 
limitations of cteim 1 . 

Further, claim 1 can be summarized with comparison to the Applicant's 
specification as provided in the following detail provided in Applicant's previously- 
filed Appeal Brief. Claim 1 is directed to a synchronization system for time- 
based synchronization of streaming media transmitted over a communications 
network. Referring to Applicant's specification, a webcast system 100 is shown 
in Figure 1 that is adapted for webcasting and is shown to include a number of 
streaming media sources 130, 150, 160 that provide streaming media inputs 
1 12, 140 that may be subjected to varying transmission delays as they are 
transmitted over the communication network 138 or the Internet 144. A 
streaming media synchronization system 110 as called for in claim 1 is shown as 
part of the webcast system of Figure 1 for generating time-synched media 
signals 1 14 by processing the streaming media inputs 112 from multiple sources. 
An exemplary embodiment of the synchronization system 110 is shown in detail 
in Figure 2. 

The synchronization system of claim 1 includes "an Input interface" that 
acts to receive first and second media stream from first and second media 
sources with each media stream including a "streaming video portion," As shown 
in Figure 2, two input streams 112 are received such as from sources 150, 160 
(and/or source 130) by 1/0 interface 210 and the inclusion of video in the stream 
is discussed at least at page 11 lines 7-21. The system of claim 1 further 
includes first and second data buffers that store the data packets from the two 
media streams as shown at 222, 224 of Figure 2 and as explained In the 
paragraph beginning at line 9 of page 16. 
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The synchronization system of claim 1 includes a controller "linked to the 
first and second data buffers for selectively retrieving the data packets of the first 
and second media streams to form a first and a second time-adjusted stream, 
wherein the controller determines a variable transmission delay" for the streams 
from the sources to the input interface and uses this variable transmission delay 
to decide when to retrieve the buffered packets. Further, the controller is 
configured "for mixing the first and second time-adjusted streams into a 
composite media stream wherein the first and second time-adjusted streams are 
synchronized based on time." An exemplary controller is shown by the controller 
and media processor 230 and 240 of Figure 2 that act to mix time-adjusted 
streams 234 to output a composite stream 114. This Important aspect of the 
system of claim 1 is explained in detail in Appellant's specification from page 15, 
line 16 to page 16, line 22. As explained, the variable transmission delay is 
determined for each of the received media streams using an external timing 
reference such as reference 120 and a time stamp or information in the received 
stream, and the determination may be done once for a stream or file or two or 
more times for a stream or file. As can be seen from the language of claim 1 
and this portion of the specification, the controller acts to both synchronize two 
media streams that include a video portion and to mix the two streams into a 
single composite media stream in which the video portion from differing sources 
is time-synchronized (e.g., as might be used to create side-by-slde screens of 
live broadcasts from differing sources and/or geographic locations or plcture-in- 
picture effects where the two streams are accurately time synchronized). 

The Office Action states cites Dean for teaching the input interface of 
claim 1 at col. 4, lines 6-22 and Figure 2 elements 161, 162. Applicant disagrees 
with this assertion because Dean teaches a conventional PIP display that is 
combining 2 signals based on frequency and phase, but there is no suggestion in 
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Dean that the input signals "comprise a plurality of digital data packets being 
transmitted over the communications network from a first and a second media 
source." This is significant to claim 1 because it is the use of a communications 
network by two media sources that are providing the first and second signals that 
creates the issue of two differing transmission delays. The portion of col. 4 cited 
by the Examiner states that typically the "two channel inputs are IN-A 161 and 
IN~B 162" which typically would come from two television channel tuners (i.e., 
from a single "source" such as a cable line or dish receiver and a content 
provider). However, Dean at this citation then states that "such signals may have 
come from two independent sources of video images, as well, such as a video 
camera and a computer device." This statement appears to have more to do 
with the fact that the source frequency and phase may differ for the two 
"sources." Therefore, Dean does not teach: (a) that the signals on channel 
Inputs IN-A 161 and IN-B 162 are digital data packets that have been transmitted 
over a communications network or (b) that the packets were transmitted over 
such a network from two differing media sources. As a result, the input interface 
element of claim 1 is missing from the teaching of Dean. 

The Office Action cites Dean as teaching the controller of claim 1 that 
functions "for mixing the first and second time-adjusted streams into a composite 
media stream wherein the first and second time-adjusted streams are 
synchronized based on time" but then in the first full paragraph of page 4 states 
that Dean does not disclose "the time-adjusted streams are synchronized on 
time. ' Applicant asserts that the second conclusion of the Examiner is correct. 
Dean is cited at col. 4. lines 51-65 and mixer 150 of Figure 2 for the first 
conclusion. The only line that seems relevant states the "mixer 150 presents the 
appropriate portion of the image to be displayed at the time the display requires 
if by retrieving images from the buffers. However, Dean is directed toward 
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frequency and phase synchronization so the "tsme" discussed here appears to be 
referring to retrieving a buffered image using a synchronization signal when a 
PIP display is demanded and ptecing the images in the PIP display in the 
primary or secondary portions as required. As discussed above, there is no 
discussion of network propagation delays or of synching the two images from the 
two input channels based on when they were transmitted from their sources. 
With this in mind, Applicant asserts that the limitations of the final wherein clause 
of claim 1 are not shown by Dean. 

The Office Action on page 4 states that Dean fails to disclose "selectively 
retrieving the data packets of the first and second media streams to form a first 
and a second time-adjusted stream, the controller determines a variable 
transmission delay for the first and the second media streams from the first and 
second media sources to the input interface and performs the selective retrieving 
based on the determined variable transmission delays, and the time-adjusted 
streams are synchronized based on time." Hence, Davies is required to show 
each of these features of the controller and also make up for the input Interface 
deficiency discussed above. 

First, Applicant asserts that Davies falls to show "the controller determines 
a variable transmission delay for the first and the second media streams from the 
first and second media sources to the input Interface." The Office Action cites 
Davies at col. 4, lines 11-30, lines 45-63, and col. 15, lines 22-46. Initially, 
"variable delay" is described In col. 2, lines 56-67 as the delay in the sensory 
audible and visible output from the separate output devices (such as a speaker 
or video display unit). Any detected mismatch in the synchronization of these 
outputs is accounted for by adjusting the variable delay applied by the gateway 
on one of the signals (e.g., typically the audio signal) to achieve a calibrated 
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synchronization (and the delay is then appHed whenever the calibrated device is 
used). However, in the Summary, there is no discussion of calculating the 
transmission delay for the data packets in the first stream due to their travel over 
the network and the transmission delay for the data packets in the second 
stream due to their travel over the network (e.g., the claim requires that "delays" 
be used to perform the selective retrieving and not a single value). Referring to 
the specific citations, at col. 4, lines 1 1-30, Davies mentions a synchronization 
delay that may involve a transit delay or propagation delay, but such a delay is 
only between the gateway device and the audio or video device and not over a 
network from two differing media sources. Also, Davies beginning at line 19 of 
col. 4 quickly returns to the discussion of a sensory output delay that is "defined 
as the time difference between the audio and video the user perceives at the 
terminal." It is this perceived difference that is accounted for and not a 
determined transit delay or as called for in claim 1 a "variable transmission 
delay." Davies teaches actually measuring the "actual delay between the audible 
and visible output, and then by storing a value corresponding to this variable 
delay in the gateway" so that one of the signals can be delayed in the gateway 
device to achieve a better synchronization in a calibrated manner. Hence, 
Davies fails to teach a controller that determines a variable transmission delay 
for two media streams between a source and an interface as called for in claim 
1. 

Second, Applicant asserts that Davies falls to show a controller selectively 
retrieves "the data packets of the first and second media streams to form a first 
and a second time-adjusted stream" wherein the selective retrieving is "based on 
the determined variable transmission delays." As discussed above, Davies fails 
to teach determining the variable transmission delays as called for in claim 1 , 
and, as a result, Davies cannot teach selective retrieval of data packets from 
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buffers based on these values. However, even If the variable detey discussed in 
Davies taught these two values, Davies would still fail to teach the selective 
retrieval of clairm 1. This is because Davies teaches in its Summary and 
elsewhere that once a calibrated "variable delay" is stored In the gateway device 
that ft is applied to either the audio or the video signal to achieve 
synchronization. This same delay is imposed by network gateway whenever the 
system is used, e.g., until new components are added. There is no teaching of 
retrieving two streams of data based on variable delays but Instead Davies 
teaches slowing one of the two streams down a particular amount to achieve 
synchronization at the output devices (e.g., the audio and video terminals of the 
combined media devices). The Office Action cites col. 4, lines 11-30 and 45-63 
and col. 15, lines 22-46 for providing the selective retrieval, but lines 11-30 
discuss the "variable sensory output delay" and how to control it by "either the 
audio or the video signal is delayed within the gateway by the appropriate 
amount" (where is selective retrieval from a buffer shown?). At col. 4, lines 46- 
63 and at col. 15, lines 22-46, Davies discusses how to account for processing 
delays (e.g., skew) within the gateway device itself in loop back type systems 
with some of these delays being "known from standard techniques for that type 
of terminal" (rather than varying each time packets are sent on a network). 
Hence, the cited portions of Davies falls to teach a controller performing the 
selective retrieval called for in claim 1 to form two time-adjusted streams from 
buffers. 

In summary. Applicant disagrees with the Examiner that Davies teaches 
the controller features that it is cited for in the Office Action. Further, Davies fails 
to overcome the deficiency discussed above for Dean in that there is no showing 
of an Input interface that receives two media streams transmitted from two media 
sources and comprising streaming video portions. Davies, instead, teaches 


21 


Serial No. 09/742,165 

Reply to Office Action of IViarch 22, 2007 

receiving an audio signal from a telephony networl< and receiving a video signal 
such as from a LAN, a WAN, or via the Internet. Hence. Dean and Davies fail to 
teach or suggest the system of claim 1 because their combined teachings fail to 
show either the input interface or the controller that functions as required to 
generate a composite media stream that is formed from two time-adjusted 
streams such that these two streams are synchronized based on time. Applicant 
requests that the rejection of claim 1 be withdrawn as not properly supported. 

Combining the teaching of these two references wouW not result in the 
claimed system. Dean teaches synching the frequency of two video signals for 
two channels selected for PIP display and Davies teaches calibrating with a 
gateway an audio output and a video output (again, a one time calibration that is 
not applied to two streams of data packets based on non-deterministic or 
continually varying network propagation delays) by delaying one of the two 
signals in an ongoing, constant fashion for that group of components. If Dean 
were modified based on Davies, the result may be that a PIP display with images 
having frequencies between their sources and the display device would be 
combined with an audio signal. But, there would still be no teaching that it was 
important to try to achieve time-based synchronization of the two images of the 
PIP display (e.g., why do 1 care if a football game on the ESPN channel is 
synchronized to account for transmission delay with a sitcom on the NBC 
channel whereas you do want to avoid jumps or other issues with flipping 
between the two images as primary/secondary?) or how such synchronization 
would be achieved. For this additional reason, Applicant believes these two 
references fail to make the system of claim 1 obvious to one skilled in the arts. 

Claims 3-5, 8, and 11-14 depend from claim 1 and are believed allowable 
over Dean and Davies at least for the reasons provided for allowing claim 1 . 
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Further, claims 3 and 4 are addressed to cases where the two received media 
streams have differing compression formats and handling the streams to allow 
mixing by decoding into compatible forms. There is no discussion of decoding 
the two streams into formats that are compatible prior to storage in buffers in 
Dean or Davies. The Office Action cites Dean at col. 10, lines 31-46 for teaching 
the limitations of claims 3 which states that the two media streams may be 
compressed on first and second compression formats that differ. However, at 
the cited portions, Dean states the shown configuration "allows for the video 
images to be processed and stored in an optimized form, for example, as 
compressed video, for synchronization purposes, then present in detailed form, 
for example, as uncompressed video, for display." This does not teach that the 
signals on the two inputs 161 and 162 are received with differing compression 
formats but, instead, seems to teach buffering the tv^o signals as compressed 
video and then processing for display as uncompressed video. Davies is cited at 
CO. 4, lines 1 1-22 for teaching the limitations of claim 4, which calls for a 
decoding device that creates first and second decoded streams from the two 
incoming streams that are compatibly formatted prior to storage in the buffers. 
As discussed previously, there is no mixing/combining of the audio and video 
signals in Davies; so, there is no reason to format them in compatible formats. 
At col. 4, lines 1 1-22, Davies is discussing sensory output delay and provides no 
teaching whatsoever regarding decoding the two signals into compatible formats 
prior to storage in buffers. For these additional reasons, claims 3 and 4 are 
believed allowable over Dean and Davies. 

Claim 5 calls for the controller to "form the composite media stream by 
combining the first and second time-adjusted streams such that the second time- 
adjusted stream has a first data packet positioned at a start time adjacent a last 
data packet of the first time-adjusted stream positioned at an end time." This is 
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to avoid dead air between two video streams. Dean is cited for teaching this 
limitation at col. 4. lines 51-65. However, Dean is concerned with P\P display 
and provides no teaching of forming composite, sequential video streams. 
Instead, Dean teaches displaying primary or secondary images in PIP 
arrangement. At col. 4, lines 51-65 the term "sequential" is used but this is only 
in reference to how video displays are generated line-by-line from top to bottom 
and this would be true for a mixed PIP display. But, the PIP image would not be 
created by placing the start time of one image stream next to the last data packet 
of the other image stream or this would result in one of the images being null or 
black (e.g., the secondary or primary image would disappear on the display 
screen). Hence, Dean fails to support a rejection of claim 5 for this additional 
reason. 

Yet further, ctelm 8 calls for a data parsing device that retrieves time data 
from the two media streams that is used by the controller to determine variable 
transmission delays for the two streams. Davies is cited at col. 4, lines 1 1-30, 
lines 45-64, and coL 15, lines 22-46 for teaching this limitation. Initially, it should 
be remembered that Davies fails to teach receiving and processing two video 
streams for later mixing/combination, and, hence, this reference cannot teach 
this limitation. But, further, at col. 4, Davies discusses measuring time 
differences and "actual delay" but there is no teaching of retrieving time data 
such as a time stamp or transmission time from received data packets for use in 
determining these time differences or actual delay. In col. 15, Davies discusses 
transmission of a marker signal to assist in determining skew caused by the 
gateway device but does not discuss retrieving "time data" from media streams. 
Since there is no teaching or discussion of the limitations of dalm 8 in Davies, 
the rejection of claim 8 should be withdrawn for this additional reason. 
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Turning now to independent claim 15, this claim is directed to an 
apparatus for synchronizing media streams transmitted over a communication 
network. As with the system of claim 1 , the streaming media synchronization 
system 110 shown as part of webcast system 100 in Figure 1 and in more detail 
in Figure 2 is a representative embodiment of the claimed apparatus. The 
apparatus of claim 1 includes an input interface, such as I/O interface 210, that 
acts to receive media streams transmitted by first and second media sources 
over a communications network. In contrast to claim 1 , the media streams are 
encoded to first and second compression standards that differ. As explained 
beginning at page 14, line 18, the compressed streams 212 received by the I/O 
interface 210 may be formatted "under different, incompatible compression 
standards and formatting schemes." \n this regard, claim 15 calls for the 
apparatus to include a decoder that decodes the two received streams into 
intermediate streams that "are compatibly formatted." The decoder may be the 
parsing and decoding manager 216 shown in Figure 2 that functions to "output 
compatible or codec neutral streams 220" as explained at lines 20-23 of page 
14. 

Claim 15 further calls for a streaming media processor, such as processor 
240 shown in Figure 2, for "mixing the first and the second intermediate-format 
media streams into a composite media stream encoded according to an output 
compression standard." For example, the streams 234 that are formed from 
codec neutral streams 220 may be mixed into a composite media stream 1 14 
using an output compression standard, with operation of the processor 240 
explained at least at page 20, line 22 to page 21 , line 21 . The apparatus of claim 
15 further includes a controller such as controller 230 of Figure 2 that determines 
a variable transmission delay for the two received media streams as discussed 
with reference to claim 1 . Claim 15 further calls for the determination to be done 
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based on transmission and receipt times for a particular data packet in each 
stream as discussed at page 16, lines 1-10. 

Independent claim 16 includes limitations similar to claim 1. Hence, the 
reasons provided for allowing claim 1 over Dean and Davies are believed 
applicable to claim 15. Additionally, claim 15 includes limitations similar to 
dependent claims 3 and 4, and the reasons for allowing claims 3 and 4 over 
Dean and Davies are applicable to claim 15. 

Claims 17 and 18 depend from claim 15 and are believed allowable over 
Dean and Davies at least for the reasons provided for claim 15. 

Independent claim 20 was rejected for substantially the same reasons as 
provided for claim 1 . Independent claim 20 is directed to a method with 
limitations similar to those of claim 1 but presented in method form. Hence, the 
description of claim 1 provided above is applicable to claim 20. Claim 20 further 
specifies that the time-adjusted streams 234 are created by correcting for the two 
determined transmission delay values by "matching the data packets of the first 
and second media streams based on transmittal times from the first and the 
second media sources." This type of matching is explained in Applicant's 
specification from line 9, page 16 to at least line 7, page 18. Claim 20 also calls 
for creating a synchronized media stream (e.g., mixing by processor 240 to 
create composite stream 1 14) by "mixing" the two media streams and requires 
that the first and second media streams "are presented in the synchronized 
media stream concurrently" rather than sequentially or serially. This concurrent 
presentation is discussed at least in the paragraph beginning at line 15, page 21 
(e.g., two or more live webcasts may be shown in separate windows or screens 
with proper time synchronization). 
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Because claim 20 indudes limitations similar to claim 1 , the reasons for 
allowing claim 1 over Dean and Davles are believed applicable to claim 20. 
Additionally, claim 20 calls for tlie two media streams to include data packets 
from one or more video files and adjusting the two streams including "matching 
the data packets of the first and second media streams based on transmittal 
times from the first and second media sources." Dean and Davies fail to show 
the use of transmittal times for either their frequency/phase synchronization of 
PIP images or for the delay of an audio signal in a gateway to match a video 
signal. The Office Action states that Davies teaches the retrieval of timing data 
from two media streams, but the citations to Davies fail to support such a 
statement as was discussed above with reference to dependent claim 8. 
Further, claim 20 specifically calls for use "transmittal times from the first and 
second media sources." Davies fails to teach determining any of its delays 
based on transmittal time with most of its discussion going toward measuring 
actual differences between the timing of outputs on audio and video terminals or 
devices. Hence. Dean and Davies fail to support a rejection of claim 20 for this 
additional reason. 

Claims 22, 23, and 25-30 depend from claim 20 and are believed 
allowable over Dean and Davies for at least the reasons provided for allowing 
claim 20. Further, claims 25 and 26 have limitations similar to claims 3 and 4 
and are believed allowable for the reasons provided for these claims. 

Further, in the Office Action, claims 6, 7, and 19 were rejected under 35 
U.S.C. §1 03(a) as being unpatentable over Dean and Davies as applied to 
claims 5 and 17 further in view of U.S. Pat. No. 6,360,271 {"Schuster"). Claims 6 
and 7 depend from claim 1 and claim 17 depends from claim 15, and these 
claims are believed allowable over Dean and Davies at least for the reasons 
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provided for claims 1 and 15. Schuster is not cited for overcoming the 
deficiencies pointed out for Dean and Davies with regard to claims 1 and 15, 
and, as a result claims 6, 7, and 19 are believed allowable over the combined 
teaching of Dean, Davies, and Schuster. 

Yet further, claims 9 and 10 were rejected in the Office Action under 35 
U.S.C. §1 03(a) as being unpatentable over Dean, Davies, and Schuster as 
applied to claim 6 and further in view of U.S. Pat. No. 5,313,454 ("Bustini"). 
Claims 9 and 10 depend from claim 6 and are believed allowable for over Dean, 
Davies, and Schuster at least for the reasons provided for allowing claim 6. 
Further, Bustini is not cited as overcoming the deficiencies of Dean and Davies 
with regard to base claim 1. Hence, claims 9 and 10 are believed allowable over 
the combined teaching of these four cited references. 

In view of all of the above, it is requested that a timely Notice of Allowance 
be issued in this case. 

The fees associated with an extension of time are provided with this 
Amendment, but no other fee is believed due with this submittal. However, any 
fee deficiency associated with this submittal may be charged to Deposit Account 
No. 50-1123. 




Respectfully submitted, 


Date 


Kent A. Lembke, Reg. No. 44,866 
Marsh Fischmann & Breyfogle llp 
(720) 562-5507 Tel 
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